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ABSTRACT 

This Training Manual for Student Service Program 
Development is being published by the WICHE program Improving Mental 
Health Services on Western Campuses as a result of work done on a 
grant from the Experimental and Special Training Branch of the 
National Institute of Mental Health. The manual presents processes 
used during on-site campus applications of the Program Development 
Model. The Program Development Model encompasses ideas and 
recommendations of task forces that were convened during the first 
three years of the grant. , Membership of the task forces represented 
all segments of the university community. Because training, in one 
form or another, is so often generic to student service programs, the 
WICHE program decided to concentrate its efforts on the systematic 
development of training programs. Training, as defined in this model 
includes training for student service personnel at all levels, but 
focuses on programs that train students to improve their academic, 
interpersonal/social, or vocational choice skills. With guidelines 
established, the next three years of the grant (1973-1976) 
concentrated first on the testing of a model that would put into 
practice a systematic approach for the development of student service 
training programs and then on the preparation of a manual for the 
model's use. (Author) 
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INTRODUCTION 



This Training Manual for Student Service Program Development is being published 
by the WICHE program Improving Mental Health Services on Western Campuses as a result 
of work done on a grant (No. 12419) from the Experimental and Special Training Branch 
of the National Institute of Mental Health. The manual presents processes used dur- 
ing on-site campus applications of the Program Development Model. 

Mode£ OnlglM 

The Program Development Model encompasses ideas and recommendations of task 
forces that were convened during the first three years of the grant (1970-1973). Two 
other models, one for the assessment of campus environments and one for the training 
of paraprofessionals and allied professionals, have also resulted from the work of 
these task forces. Membership of the task forces represented all segments of the uni- 
versity community-^students, faculty, student services, administration, and governing 
boards. Each task force's charge was to develop new ideas for the delivery of student 
services. 

One theme common to all task forces was the need for a systematic approach to 
developing student service programming. The recommendations and ideas of the task 
forces for improving the development of programs became guidelines in choosing a model. 
Foremost among these guidelines were (1) the use of a planning team on which students 
and other campus constituencies having a relationship to the program idea would be re- 
presented in order to give their ideas concerning the development of a program, (2) the 
use of student volunteers or paraprofessionals and allied professionals in the delivery 
of programs, and (3) the use of assessment for both planning and evaluating programs. 

Because training, in one form or another, is so often generic to student service 
programs, the WICHE program decided to concentrate its efforts on the systematic de- 
velopment of training programs. Training, as defined in this model, includes training 
for student service personnel at all levels, but focuses on programs that train students 
to improve their academic, interpersonal/social, or vocational choice skills. 

With guidelines established, the next three years of the grant (1973-T976) con- 
centrated first on the testing of a model that would put into practice a systematic 
approach for the development of student service training programs and then on the prep- 
aration of a manual for the model's use. 
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The model that was adopted by the WICHE program for testing and refinement 
through on-site campus applications was created by Drs. Marv Moore and Ursula 
Delworth and first presented in their paper entitled "Initiation and Implementa- 
tion of Outreach Programs," Student Development Staff Paper , Vol. V, No. 2, 
1974-75, published by the Division of Student Affairs, Colorado State University, 
This WICHE training manual only expands on Drs. Moore and Delworth 's original ideas 
as dictated by processes developed through the on-site campus applications of their 
model , 

In creating their model for the development of training programs, Drs, Moore 
and Delworth incorporated aspects of work done by colleagues at the Colorado State 
University Counseling Center. They employed classifications of the model on the 
dimensions of counselor functioning (Cube) which was developed by Drs. Weston H. 
Morrill, Eugene R. Getting, and James C. Hurst, and fully described in their 
article "Dimensions of Counselor Functioning" in The Personnel and Guidance Journal 
(Vol. 52, No. 6, February 1974) as planning aides for the development of training 
programs. 

In recent years there has been a great demand for student services to enhance 
educational and personal growth among large numbers of the campus's constituencies. 
Because training readily accommodates large groups and the variety of needs therein, 
programs that offer training in the knowledge and skills needed to maximize educa- 
tional and personal growth have proliferated. However, in the enthusiasm to fulfill 
needs and meet demand, student services have not always used a systematic approach 
in developing these programs. The result has been that some programs have been 
very successful, others unsuccessful, and some continue even though they have out- 
lived their usefulness; yet student services have little understanding of how or 
why these outcomes have occurred. 

A systematic approach to developing programs can do much to alleviate this 
quandry and ensure the design of programs to achieve desired purposes. The five- 
stage model presented in this training manual provides a system^.tic approach for 
the development of training programs. Readers are urged to uce this manual with 
the understanding that it presents as complete a picture of the program develop- 
ment processes as possible. These processes are guidelines that successful pro- 
gram planners have consistently used. Experienced student service planners will 
undoubtedly think that the manual has overexplained some processes. The decision 
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Each campus planning team worked patiently and creatively with the model. 
Their efforts have provided valuable assistance and information for the preparation 
of this training manual. It is with deep appreciation we thank the members of the 
planning teams who used the Program Development Model at the following schools: 
California 

University of California, Davis 
Hawaii 

Honolulu Community College, Oahu 
Kapiolani Community College, Oahu 
Leeward Community College, Oahu 
Maui Community College, Maui 
University of Hawaii at Hilo 
University of Hawaii at Manoa 
Windward Community College, Oahu 

Utah 

Utah State University, Logan 
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TRAINING MANUAL 
FOR 

STUDENT SERVICE PROGRAM DEVELOPMENT 



Stage I 

GznmlnaJi Jdza lyiUxat Planyiing Tojm A66QA6mzyvt 

P/iog^m Suggi2Atioyi6 ?/iog/iam SutzdtioYi 
?n,ogn,am*6 FutuAz VzvoJiopmzyvt o^^ a FuLl Planning Toxm 

The central purpose of Stage I is to get the development of a training program 
off to a sound start. Initially » some idea for a training program has to be generated 
in someone's mind. Whatever the source, the originating idea is considered to be the 
germinal idea in this model for the development of training programs. The first pro- 
cesses involve studying the germinal idea in order to initiate a planning team and 
to determine the idea's potential need, population, and purpose. The next processes 
help suggest program choices to implement the idea and identify the one most feasible 
to develop. The final tasks in Stage I involve obtaining a conmitment to establish 
a full planning team and to continue the selected program's development through its 
pilot test in Stage III. 

Stage I assessment procedures are designed to gather information about the ger- 
minal idea in an organized way so that the information can be fed directly into the 
model's method for suggesting possible programs. The assessment procedure also 
gathers information about similar program efforts and the training methods used to 
implement these at other places which will provide valuable information for the pro- 
cesses in Stage II of the Program Development Model. 

The model uses the program classification system developed for "Dimensions of 
Counselor Functioning" as a framework for generating program suggestions • The system 
contains a set of definitions that classifies programs along three dimensions. The 
pictorial representation of this system is presented in a cube-like diagram, and so 
it has become known popularly as the "Cube." Because the system provides for various 
types of program purposes and populations, planners can use it to identify a variety 
of program suggestions to implement the germinal idea. A creative training program 
can be selected as the result of this process. 

Of course, resources can constitute a constraint on any program development 
endeavor. Therefore, Stage I includes feasibility checks as an important step in 
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the final selection of a training program for the germinal idea. However, the 
model's procedures for assessing the germinal idea, generating program suggestions, 
and making a final program selection enable planners to enter Stage II processes 
with the most creative program possible within the bounds of available resources. 

An effort such as this is a large undertaking for a single individual, and any 
program development is best served by more than one perspective. Thus, Stage I sug- 
gestions include the formation of a small group of people to complete the Program 
Development Model's initial processes. Once the need, purpose, and population for a 
program have been determined, the initial group should reformulate into a full plan- 
ning team. At this juncture in the model some members of the original group may ter- 
minate their association with the development process, while others will be recruited 
to provide the input and skills necessary to continue the process and begin work on 
Stage II. 

GoAmlnat Idza 

What is it that initiates work on development of a student service 
V^au^6lon training program? Usually, someone on a student service staff has 

an idea for a course of action that would improve service, fulfill a 
need, serve a new population, or otherwise facilitate educational or 
personal growth within the campus community. Any number of things 
could trigger this idea. It could arise out of observations, systematic 
assessments, intuition, or the desire to join with other colleagues and 
try something new or a new approach for a service already offered. 

In the inherently creative atmosphere of a college community, a sug- 
gestion for a student service program can also originate from sources 
outside the student service network. Again, observations, data, need, 
problems, and desires, among many other things, trigger ideas for pro- 
gramming. The originator of the idea will make his/her suggestion known 
to the appropriate service, and usually someone on the service's staff 
will undertake work on the idea. 

Regardless of how the germinal idea for a training program originated, 
it needs to be checked out in several ways before the development of a 
program to implement it should proceed. Too often these initial steps 
in the program development are overlooked. When this happens there is 
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the danger that the idea can dictate the program's development rather 
than a program being developed for the idea. Another danger of fail- 
ing to check out the idea is that the resultant program could fail to 
produce maximum outcomes* It is also possible for a germinal idea to 
contain the seeds for more than one type of training program. They will 
surface as the germinal idea is reviewed and investigated. The related 
ideas can then be dealt with as separate germinal ideas rather than re- 
maining untapped within the original germinal idea* 

★ ★ ★ 

lyiLttat Plamiing Ttm 

The originator of the idea or staff member appointed to work on the 

Vl6aLU6loyi germinal idea will first need to assemble some people to help explore 
it. These people will constitute the initial planning team. While a 
full planning team could be assembled at this point, this model suggests 
that, until further investigation and subsequent refinement of the germi- 
nal idea has been completed, the ultimate composition of a planning team 
is not sure. Thus, for the purpose of Stage I processes, the planning 
team needs only a few members. 

Composition of the initial planning team, however, is as critical as the 
composition of the full planning team. Certainly it is wise to plan with 
those who will be affected by the idea rather than plan for them. Obvi- 
ously the germinal idea gives important clues about who might be initial- 
ly convened for the planning team. If the idea should encompass the 
interaction of several university units, then a representative from each 
unit should be recruited. 

For instance, if the idea suggests a study skills program, the team 
could include representatives from areas such as counseling, academic 
advisors. Educational Opportunity Programs, students, and the campus 
learning lab or center. 
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The planning team's first tasks involve getting acquainted, developing 
a working relation'^hip, and learning what knowledge each member has con- 
cerning the germinal idea and what further knowledge needs to be estab- 
lished. It may well take several meetings to bring out everyone's im- 
pressions, observations, and thoughts about the germinal idea. It is 
important to devote time to this because it will provide the team with 
an in-depth knowledge about the germinal idea. 

The following questions are suggested as guidelines to help focus the 
team's opening discussions. As each team member gives information about 
the idea, it should be recorded and then reorganized according to what 
the information says with regard to a demonstrated need for the idea, 
the population or who within the campus community would benefit from 
the idea, and resources that could be useful in implementing a program 
for the idea. This procedure assists the team to conclude its opening 
discussions ready to formulate an assessment plan. The suggested guide- 
line questions are: 

1. Why is each member interested in the germinal idea? 

2. What are each member's perceptions on why and how the germinal idea 
originated? 

3. If the originator of the germinal idea is not a member of the plan- 
ning team, who was the idea's originator, and what, if any, signif- 
icance has this person imparted to the development of a program for 
the idea? 

4. What documents such as reports and survey data can each team member, 
as well as the idea's originator, identify or cite that demonstrate 
a need for action on the germinal idea? 

5. Are there any negative consequences that action on the germinal idea 
might generate within sections of the campus community? 

6. What else do planning team members want to know about the germinal 
idea? 

A brief example of information organized after a planning team*s opening 
discussions on the germinal idea "improve freshman advising and their 
learning skills" might look like this: 
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Need 

1. About 30% of the freshmen are leaving after the first semester. 

2. About 15% of the freshmen are dropped after the first semester for 
having an insufficient grade-point average. 

3. About 30% of the freshmen are on academic probation after the first 
semester. 

4. Department secretaries report an overload of incoming freshmen anx- 
iously Inquiring about who is their advisor. 

Population 

1. First-semester freshmen 
Resources 

1. Learning Skills Center 

2. Senior service club, which offers advising and tutoring to freshmen 

3. Residence hall staff 

4. Facul ty advisors 

5. Department heads 

6. Registrar's office 

7. Administration (several regents and the president) who are voicing 
concern over the problem of freshman attrition and who offer poten- 
tial support for improving the advising and learning skills programs 

Team Members Would Like to Know 

1. How does each department assign advisors? 

2. Which advisors are willing to work with high-risk freshmen? 

3. What are the mailing schedule and type of mailings to incoming 
freshmen? 

4. What are the present services of the Learning Skills Center? 

5. What are the resources and interests of the Learning Skills Center? 

6. How committed is the administration to providing additional support 
for advising and learning skills for freshmen? 

★ ★ ★ 
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After organizing the information collected through debriefing each team 
Vi^ciUy^lon member's knowledge about the germinal idea, the team is ready to formu- 
late and implement assessment strategies that will provide more informa- 
tion about the extent of need, target populations, and resources. If, 
during the team's initial discussions, it becomes apparent that the 
germinal idea encompasses related germinal ideas, the team will need to 
choose one particular idea on which to concentrate. For example, after 
the team's initial discussions on the above germinal idea, it decided 
that freshman advising and learning skills for freshmen constituted two 
separate program development efforts, so the improvement of freshman 
learning skills was chosen. 

The extent of the team's further assessment on the germinal idea will 
depend on how much information the team has already generated and how 
much more and what type of information is still needed. A good rule to 
follow is that the more information surfaced about the idea, the better 
the chances are a program will ultimately be chosen that will best serve 
the germinal idea's intentions. 
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Therefore, it is recommended that the planning team review the summaries 
or listing of its current state of knowledge about the germinal idea 
while asking itself the following questions to determine what else should 
be assessed. 

1. What data, subjective and objective, should we obtain that: 

a. Will help us specify our needs? 

b. Will substantiate the extent of the need? 

c. Will identify recipients or consumers for the idea? 

d. Will define the characteristics or make-up of the ideals recip- 
ients or consumers? 

2. What data or information do we need concerning: 

a. Possible personpower resources such as professional colleagues, 
staff members, and students involved with or skilled in the area 
of the germinal idea? 
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c. 



d. 



Possible organizational resources such as service groups, 
classes, dormitory system, other programs, and other student 
services that could be useful vehicles for implementing a pro- 
gram for the idea? 

Possible support, monetary and influence, that might exist with- 
in student services, administration, and/or academic departments? 
Possible resistance or negative consequences that might result 
from action on the germinal idea? This last point becomes par- 
ticularly critical when a germinal idea touches upon sensitive 
areas such as moral, political, or religious issues. A classic 
example would be the conflicts witnessed in this nation's school 
districts over sex education programs. Program ideas need not 
be negated because of possible resistance or negative consequences 
if the planning team is able to inform itself fully on the issues 
so that it can develop an acceptable program. In those cases 
when this cannot be satisfactorily done, it is better to deter- 
mine this fact beforehand than after a program has been developed. 
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Once the planning team has decided what else it wants to .assess, it can 
employ many techniques including questionnaires, surveys, and personal 
interviews. In fact, assessment can be done in as many ways and on as 
many subject areas as the team has time and creativity to select. There 
is, however, a set of sources from which to obtain data and information 
that should not be overlooked. 

1. A search of current literature concerning the idea should be made 
and catalogued according to what is said about identified needs, 
population served, resources, and training methodologies. Often 
the planning team can find a student in special studies or taking 
a course for whom the literature search could qualify as a project 
for credit. The use of ERIC or similar literature retrieval systems 
can also greatly facilitate the search^ 

2. Campus records such as admission's demographic information, student 
service intake records, grade-point averages, and dropout records 
should not be overlooked when they contain data pertinent to the 
germinal idea. 

17 
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3. Informal or unobtrusive data such as student attendance at events, 
lectures, or activities that would indicate sufficient interest to 
warrant support for the germinal idea. For example, a large turnout 
for guest lectures on new dating patterns, full attendance plus non- 
registrants for a general mental health class lecture about intimacy 
concepts and premarital sex, and faculty reports of students seeking 
advice on premarital problems would all indicate the need to develop 
some kind of training program for a germinal idea about improved re- 
lationships for dating and planning marriage. 

4. A search should be conducted throughout the campus for programs in 
progress that deal in the subject area of the germinal idea. Those 
that are found should be contacted (by means of brief questionnaire, 
telephone, or personal interview) to determine what the program is 
doing--its purpose, methods, and participants. It may be that there 
are enough services or programs currently available to fulfill the 
germinal idea. In this case the team could decide that there is (a) 
a need 'for coordination; (b) a need for better publicity; or (c) a 
need for changes that would improve what is available, and so work 
on a separate program effort should stop. If the team reconstitutes 
to plan publicity or improvements, it is suggested that the remaining 
processes in this Program Development Model can be used to design 
improvements and/or publicize programs. 

5. If the germinal idea indicates a particular consumer population, or 
as the planning team begins to define a particular consumer group, 
it would be wise to conduct a sample survey on how members of the 
proposed consumer population perceive needs for the germinal idea 
and to identify any special characteristics this population might 
have. 

6. Similarly, it may be appropriate to conduct a sample survey of 
people who have close contact or deal directly with the consumer 
population regarding these people's perception of consumers' needs 
for the germinal idea. 

* * * 

18 
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VKOQKm Sagged tion^ 

A number of program suggestions should be generated for the germinal 
V^cu^^ion idea. This is a crucial step in the development process because too 

often the same type of program is developed for every germinal idea. 

Programming settles into a familiar and comfortable rut for the service, 

but falls short of the full potential it might have achieved if it had 

been designed differently. 

The "Dimensions of Counseling Functioning" (Cube) model, developed by 
Morrill, Getting, and Hurst, is a device for plotting a program along 
three dimensions: the program's Purpose of Intervention, Target of 
Intervention, and Method of Intervention (Fig. 1, p. 11). It is used in 
this model as a device to stimulate divergent thinking about what type 
of program might be developed for a germinal idea. Its classification 
system provides a useful framework on which to study the team's assess- 
ment data and identify program suggestions. 

The Purpose of Intervention dimension has three classifications: 
Remediation, Prevention, and Development. The Target of Intervention 
dimension has four classifications: Individual, Primary Group, Associa- 
tional Group, and Institution or Community. The Cube's third dimension. 
Method of Intervention, is helpful to the program development processes 
in Stage II and will be discussed later. 

An explanation of Purpose of Intervention is as follows: 

Remediation Programs-^Here, the data would demonstrate deficits with- 
in persons or negative elements in a campus environment. Suggested pro- 
grams would react to correct these. Example: a learning skills train- 
ing program to bring below-average students to the required level of 
functioning. 

Prevention Programs--Here, the data would demonstrate potential de- 
ficits and potentially negat-^ve elements. Suggested programs would pro- 
actively intercede to prevent these from deteriorating into destructive 
results. Example:- a freshman advising program to help students negotiate 
their new environment and thus prevent dropouts. 

Development Programs— Here, data would demonstrate attributes and 
positive elements. Suggested programs would proactively intercede to 
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FIGURE 1. DIMENSrtNSOF COUNSELOR FUNCTIONING (CUBE)* 



A. TARGET OF INTERVENTION 



!1) Individual- 



(2) Primary Group. 



(3) Associational Group 



(4) Institution or Community ■ 



B, PURPOSE OF INTERVENTION 




(1 ) Remediation 

(2) Prevention 

(3) Development 



(3) Media 

•(2) Consultation and Training 
•(1) Direct Service 



C. METHOD OF INTERVENTION 



*Thls figure©1972 by Weston H. Morrill, Eugene R. Getting, and James C. Hurst, and is reproduced with their permission. 
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intentionally enhance or enrich persons and/or their environments. 
Example: a speed -reading skills program to enhance students' reading 
abil ities. 

Target of Intervention involves the following possible program targets: 

Individuals- -Here the program's consumers would be individuals. Sug- 
gested programs should address such influences as an individual's feel- 
ings, attitudes, perceptions, level of knowledge, and skills. 

Primary Groups- -Here, the program's consumers would be two or more 
persons with an ongoing, close, interdependent relationship, such as 
couples, roommates, or families. Suggested programs would address such 
influences as the communication patterns, perceptions, values, attitudes, 
knowledge, and relationships that exist between or among the individuals 
in the primary group. 

Associational Groups- -Here, the program's consumers would be a group 
whose members know each other and are dealing with the same needs, in- 
terests, or goals. Examples: residence hall floor, club, or college 
class members. Suggested programs would address such influences as the 
values and goals, communication patterns, interactions, organization, 
and structure of the associational group. 

Institution or Community- -Here, the program's consumer members would 
be a college or school within a university or the entire campus communi- 
ty. Suggested programs would address how the members could achieve de- 
sired functional outcomes through the use and/or alternation of such in- 
fluences as system linkages, power distribution, sanctions, information 
flow, values, and goals. 



The planning team uses its assessment information on needs to suggest 

VKodO^hl programs for the Cube's three classifications of Purpose of Intervention. 
"Cube I^" 

This assists the team to identify alternate programs that could fulfill 
the demonstrated needs. The team also uses its information about popu- 
lation to suggest programs for the Cube's four classifications of Target 
of Intervention. This assists the team to identify alternate ways a pro- 
gram could be of benefit. 

2i 
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To generate program suggestions, the planning team reviews its as- 
sessment data for demonstrated needs that reflect deficits or nega- 
tive elements that could be corrected and then studies this informa- 
tion in. light of its data on population to suggest Remediation pro- 
grams targeted for Individuals, Primary Groups, Associational Groups, 
and Institutions or Communities. 

The above process is repeated for needs that reflect potential def- 
icits or potentially negative elements that could be prevented and 
finally for needs that reflect attributes or positive elements that 
could be further developed. 

In some cases, the assessment data will fairly evenly support action 
among all three purposes. The team could conceivably develop a pro- 
gram to achieve all three purposes or it may choose the purpose felt 
to hold the most significant impact for the consumer. (This might 
be a situation when the team will want to conduct further assessment 
to ascertain from the intended consumers which purpose they would 
perceive as most useful.) 

Generally, however, assessment data will be more supportive of action 
for one purpose. This is a good indicator that a program should be 
developed to achieve this purpose. 

While assessment data will readily support program suggestions for 
one Target of Intervention--Individuals--the team should always try 
to suggest a program for as many Targets of Intervention as possible. 
(An example showing program suggestions for various combinations of 
the Cube's Target and Purpose classifications is given on p. 14.) 
When the plotting of program suggestions for each purpose and target 
combination has been completed, planners should choose the most 
likely possibilities to undergo a review for the final selection of 
a program. 

★ ★ ★ 
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Example: Programs to raise the level of academic achievement among students who live 
in campus housing as suggested for various combinations of the Cube's target 
and purpose classifications. 



Target 


Purpose 


Individual 


Remediation 


Prevention 


Devel opment 


Learning skills 
for students with 
less than a 2.0 
grade-point average 


Series of learning 
skills workshops at 
each residence hal 1 
for identified high- 
risk students 


Offer in residence 
halls special 
learning modules 
for advanced 
writing and read- 
ing skills 


Primary 
Group 




Prepare and dis- 
tribute to couples 
in married student 
housing a manual 
on "How to Set Up 
a Study Corner" 


Offer workshop 
on helping your 
partner graduate 


Associational 
Group 


Learning skills 
that util ize group 
interaction for 
members of a res- 
idence hal 1 whose 
average has fal len 
below a 2.0 grade- 
point average 






Institution 
or 

Community 


Train residence 
hall assistants on 
how to better 
identify and refer 
marginal students 
to learning skills 
programs 


Train residence 
hall assistants 
about study envi- 
ronments and how 
these can be 

implemented in \ 

residence hal Is 


Same program also 
achieves this 
purpose 

— > 
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Before making the final selection of a training program on which to 
proceed, the team will need to review its assessment information on 
available resources and should review the purpose and targets being 
met by the service's current programs. Obviously, resource constraints 
will have a direct bearing on which suggestion the team can develop 
without overextending the service's program endeavors. A comparison of 
the possible programs' purposes and targets should be made with current 
program purposes and targets in order to avoid having one type of purpose 
or target overrepresented in the service's programming. A review of both 
resources and current purposes and targets is essential to the proper se- 
lection of an idea for a full program development effort. 



Members of the planning team should: 

1. List the service's current programs and identify the purpose and 
target each fulfills in the Cube's classification system. (See 
Technical Appendix for an example of mapping a service's outreach 
programs , p. 57. ) 

2. Determine, depending upon current program's purp^:,es and targets, 
how the suggested pro^gram purposes and targets replicate or serve 
new dimensions of the service's community. 

3. Using the information on resources gathered earlier, make an in- 
ventory of the possible personpower resources and materials needed 
for the programs from among service staff and other campus profession- 
als, programs, and students. 

4. Check with everyone identified to determine if he/she could make time 
or materials available, and, if so, for which program suggestions, 
how much time, and what materials. 

5. Make an informal assessment of colleagues' and authorities' opinions 
concerning commitment/enthusiasm for each program suggestion under 
consideration. 

6. Make up a chart that readily displays a comparison of the information 
gathered in steps 1 through 5 against the resource needs for each 



15 

24 



program suggestion in terms of personpower, materials, space, funds, 
and any other needed resources. 
7. Review information chart and choose which program suggestion is most 
feasible, given its target and purpose, the resources available, and 
degree of enthusiastic response or commitment its imple?^ientation 
would receive. If the suggestions first under consideration turn 
out to be unfeasible or serve an overrepresented purpose or target, 
the planning team may choose to end the project. However, because 
an array of program ideas were plotted on the Cube, the team also 
has the option of looking back over these to choose another program 
idea that better matches resources available and that is compatible 
,vith constructive programming. 

★ ★ ★ 

In most cases, someone or some agency or group determines whether the 
Vi^cu^^lon program will be undertaken. The planning team approaches this crucial 
point backed by firm data and statistics on need and resource feasibil- 
ity and a creative program suggestion. 

The agency or group making the decision will most likely weigh the pro- 
gram suggestion against considerations similar to those displayed on the 
team*s information chart as well as against its needs determined by 
higher administrators or university expectations and its budgetary re- 
serves. Therefore, the team should use pertinent data from the informa- 
tion chart to develop a program prospectus that will assist the decision- 
making process concerning these issues as well as seek a commitment to 
the program's development through its pilot test and evaluation. 




Planners should: 

1.^ Prepare the program prospectus to include the fallowing information: 
a. The nature of the germinal idea's source and concomitant implica- 
tions for the student service, if any. 
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b. Demonstrated needs for the program as established from the re- 
search on the germinal idea- 

c. A brief explanation of how the program supports student service 
goals as evidenced by the purposes and targets being served in 
current programming or how the program can fulfill a new goal by 
serving its unique purpose and target. 

d. Identification of resources likely to be available for the pro- 
gram's operation and resources that will be needed. 

2. Prepare an explanatory statement to the effect that, if the program 
is to be undertaken, the planning team will need a time commitment 
to proceed through Stage III of the Program Development Model, which 
will entail developing specific goals, an appropriate delivery system 
and evaluation procedure for the program, and a period for testing 
and evaluating these in a pilot run of the program. 



★ ★ ★ 



VzveZopfnzyvt o{i a Full Planyiing Tmm 

Once the program suggestion has been accepted and a commitment for its 

P^ca6-6Xon further development secured, the initial planning team will need to re- 
formulate into a full planning team. New members who incorporate the 
skills necessary for further development of the program suggestion will 
have to be added and some of the original members may leave the team. 
Although primary responsibility for a program resides in the initiating 
agency, additional team members should be recruited from other agencies, 
academic faculty, and student body on the basis of their interest and 
skills. 

The utilization of other personnel affords 'distinct advantages. Besides 
the obvious benefit of additional creativity, the specialized skills of 
individual team members may be tapped to facilitate the various tasks in 
the Program Development Model process. Diversified team membership also 
encourages efficient utilization of resources within the broad area of 
student services. Perhaps the greatest benefit of a team effort is the 
mutual support and encouragement that members can give each other in the 
sometimes slow and difficult parts of the rather long process. Likewise, 
success often seems richer when shared with an interested teammate. 
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There are at least four categories of personnel from which planning 
team members should be recruited: 

1. Professional . This term denotes a professional worker in the field 
in which the program is being developed. 

2. Al 1 ied Professional . This term is applied to a person who is a pro- 
fessional in his/her own field, but who is engaged in program devel- 
opment or implementation in another field. A minister or academic 
faculty member is an allied professional for student service programs. 

3. Paraprofessional . This term denotes a student or other nonprofes- 
sional person given special trailing by an agency to conduct some of 
the tasks usually performed by professionals. This person may be em- 
ployed or a volunteer. Some student services include graduate stu- 
dent trainees in this category. 

4. Target Population Member . This term usually denotes students. How- 
ever, depending on the program, a target population member could be 
others in the campus community. The immediate feedback students can 
provide on proposed ideas or training experiences is invaluable to 
the student service program development process. The inclusion of 
students on the full planning team can save planners from embarrass- 
ing and time-consuming mistakes, and students can also become impor- 
tant resources as program implementers. 

The functioning of a full planning team is as important as the selection 
of its members. Programs can go awry if team members cannot reach com- 
promise positions or solutions on important issues. The program develop- 
ment process can become overwhelming or get bogged down if processes are 
not employed to keep ideas generating within manageable segments of the 
overall task. And because the team approach is used to enrich the pro- 
cess and its end product with the array of perspectives and skills its 
members contribute, processes will also have to be employed that allow 
these attributes to be recognized and understood by each team member. 
In other words, some perspectives may be threatening to other perspec- 
tives represented on the team, and some skills and their attendant re- 
quirements may not be understood by those on the team who are unfamiliar 
with the skill. The cross-fertilization and subsequent enrichment inher- 
ent in a team approach will, at various times, need attentive care. 
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The core skills and characteristics most desirable in team members in 
addition to the criteria outlined for the selection of members to the 
initial planning team include: 

1. Ability to make commitment to regular team meetings and additional 
tasks outside the meetings. 

2. Ability to work as a team member in terms of task and group processes. 

3. Specific skills in one or TOre of the following: 

a. Knowledge of program subject area. 

b. Familiarity with population for which the program is being de-* 
veloped . 

c. Evaluation/research skills. 

d. Communication/writing skills. 

e. Process observer skills (see Technical Appendix, pp. 59-63.) 

Criteria and processes important to team functioning include: 

1. A team member who clearly assumes the leadership role of guiding the 
team through the various tasks in the program development process. 
The initial planning team leader or a new leader may be selected to 
fulfill this role. The leadership function requires the following 
abil i ties : 

a. Coordinating and directing the activities of the team. 

b. Knowing team-building techniques and using them as appropriate 
(see Technical Appendix, p. 55). 

c. Leading resolution of conflict between two members or among 
factions of the team, 

d. Conducting brainstorming and prioritizing sessions (see Technical 
Appendix, pp. 71-72). 

e. Confronting team members who are not doing their contracted work. 

f. Giving systematic, positive feedback and reinforcement to team 
members. 

2. The specialization of program development tasks is to be encouraged 
in team members. 

3. Whenever possible, specific work responsibilities should be assumed 
by or assigned to specific team members with a clear indication of 
the expected completion date. 
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Conflicts and disagreements between team members are best dealt with 
in an open manner, as they occur. 

Written summaries of each meeting keep all team members involved and 
informed. Responsibility for recording the proceedings may be dele- 
gated to a regular secretary or assumed by various team members. 
A regular meeting time and place is clearly advisable. Equipping the 
meeting room with newsprint or a blackboard enhances the expansion of 
ideas and facilitates brainstorming when it is necessary. 

★ ★ ★ 
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stage II 



P/iognm GoaJU and Bohavlo/i ObjtcJUvQJ:> J/icUyiLng 
Me^dfiod IntoJivtyvtion VKOQ^jom EvalucUlon 



Stage II in the development of a training program involves core planning for the 
program's system of delivery. Planning begins with the setting of goals that must be 
achieved if the program is to fulfill its purpose. Training that will provide what is 
needed to achieve these goals is then developed. Who delivers this training and how 
this training will be delivered is the next step in planning the program's delivery 
system.- Finally, methods of program evaluation and the research design used to imple- 
ment these are planned. After the planning team has developed the program's system of 
delivery, it can proceed with the preparations necessary for the program's pilot test. 

' Goal setting and behavioral objective procedures for Stage II are designed to pro- 
vide crucial information for the development of training and evaluation. Information 
on training programs and procedures gathered during the assessment in Stage I provides 
resource material for the selection of training to implement program goals. Classifi- 
cations of the Cube*s Method of Intervention are used to assist in the identification 
of who will deliver the training and how it will be delivered. 

Because program goals become stated in terms of behavioral objectives, the model's 
processes for setting up program evaluation concentrate on how the planning team may 
select standardized instruments or devise instruments that measure the desired behav- 
ioral . changes. Stage II concludes with a series of processes useful in preparing for 
the program's pilot test. These processes focus on the mechanics that will put the 
results of Stage I and II planning into operation. 

?/iogHxm GoaJU (md Be^kavZonxiZ ObjzctLvoM 

An important but often neglected process in the development of a train- 

VA^dM^lon ing program is to make explicit the goals that are implicit in the pro- 
gram's purpose. Equally neglected and equally important is setting be- 
havioral objectives for achieving these goals. To obtain this needed 
specificity, the Program Development Model utilizes a three-step proce- 
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dure adapted from the work of Drs. Richard G. Weigel and Max R. Uhlemann 
in setting behavior change objectives for therapy groups. The stepwise 
procedure consists of planners developing general goals for its program 
which are subsequently translated into general objectives and finally 
into behavioral change objectives for the participants of the program. 
These behavioral objectives serve two important purposes: first, they 
win greatly aid the planners in identifying the training procedures 
that must be offered to achieve program goals. Second, they will help 
program planners to select or more easily create the measures needed to 
evaluate program effectiveness. 

The process as outlined in this stage is very behavioral in bias. The 
reader must be cautioned to keep the methods and language of evaluation 
from becoming an end in themselves. Human service programs created for 
personal growth by people are infinitely richer than the behavioral ob- 
jectives constructed to linearly describe and evaluate such programs. 
Such programs are usually intuitively conceived in the reverie of a day- 
dream or a very nonanalytical moment. Sometimes such noncogni tive, intu 
itive sparks give birth to the whole gestalt and even see how it will 
work before a behavior objective is attempted. 

Behavior objectives and evaluative analyses are not the sparks that 
kindled the generative flame of ideas, nor are they the rich experience 
or program participants and leaders who partake of it. The behavioral 
analyses simply round out and complete our consciousness of the program 
experience so that it may be shared and compared in a consensual ly used 
scientific language. If this fact is overlooked, programs may become as 
sterile and lifeless -as the statistical analyses computed and reported 
to demonstrate their effectiveness. 



Based in part on papers presented by^ichard G. Weigel, Ph.D., and Max R. Uhlemann, 
Ph.D., Colorado State University, at meetings of the American Personnel and Guidance 
Association (1969), the American Group Psychotherapy Association (1971), and the 
American College Personnel Association (1975). 
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The process of behavior goal setting moves through at least three levels 
?>ioau6/ of specification, from broad, abstract goal statements to very specific 
behavioral statements. Level I goals are obtained by answering the 

bOCLC6 , 

IdvoJi I question, What is(are) the broadest mission(s) of our program? The 
brainstorming process (Technical Appendix, pp. 71-72) is utilized to 
generate answers to this question and the questions posed by each sub- 
sequent level . 

Example: What is the broadest mission for a High-Risk Freshman Learning 
Skills Program? A General Goal formed in response to this question 
might be to improve skills that freshman students need to succeed aca- 
demical ly in college. 

To complete Level II of the goal -setting process, the planning team will 
P/Loce^^/ need to restate each general goal in terms of the behavior students 
Ofa^ecxiuc^ would display if they had achieved the general goal. There may be sev-- 
LtvoJi II eral behaviors participants could display if they had achieved the gen- 
eral goal. Each of these should be stated as a general objective. To 
identify general objectives, it is suggested that planning team members 
generate answers to the question, How would program participants behave 
differently if they achieved the general goal? Answers to this question 
are brainstormed for each general goal. Next, the resultant general 
objectives will be prioritized in order of importance to the planning 
team. 

Example: How would program participants in a Freshman Learning Skills 
Program behave if they gained the skills needed to succeed academically 
in college? The General Objectives formed in response to this question 
might be: 

1. Participants will be able to organize their time so that they can 
get enough studying done and still have some social/recreation time. 

2. Participants will be able to give their professors regular positive 
and negative feedback. 

3. Participants will be able to take objective examinations without 
blocking anxiety. 

4. Participants will be able to write term papers in an organized and 
clear fashion. 
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team decides to work for awhile on the delivery system brainstorming, 
then it must later work backward and generate the objectives that the 
training task would accomplish. The authors do not advocate working 
through each step in a rigid, nonalterable sequence. Rather, the levels 
of specificity in the behavior goal^setting process are meant to provide 
a conceptual overlay for organizing the creative process Into a meaning- 
ful whole. 

★ ★ ★ 

By translating general program goals into behavior change objectives for 
Vi^QJLUiJblon the program, the team will have gained a complete and clear understanding 
of what the program is to accomplish and the behavior changes that will 
need to occur. This knowledge enables planners to systematically develop 
training tasks and procedures based on behavioral objectives rather than 
on someone^s personal whim or a staff member*s special training interests. 

The team's assessment information gathered on similar program efforts 
also facilitates the development of training. It provides resource mate- 
rial from which to select or modify previously developed training tasks 
and procedures. This enables the planning team to more quickly determine 
what training it will have to originate and what training it can easily 
adopt for the program. 



To develop training, the planning team should: 
P/L0<ie64 1. Devise a general training format and check this out for "fit" after 

the development of training procedures for specific behavior 
objectives . 

2. Review, in light of the list of behavioral objectives it has set, 
the summaries of related practice literature made in Stage I, asking 
the question, Does the piece of literature describe a training task 
that could achieve one or more of the behavior objectives? In this 
manner a list of training procedures from other programs can be com- 
piled for the nianning team's consideration. 
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Example: General Training Format for One Sul 
Learning Skills Program for High-R 
class members will be able to give 
negative feedback. 

Behavior Change Objectives 

1. Class members will speak up in a 
designated class every day at 
least twice to give their reactions 
about the lecture or lab. 

2. Class members will orally give one of 
their professors a compliment about 
some aspect of the lecture, lab, or 
teaching style that they liked-- 
privately after class, once every 
week. 

3. Class members will at least once 
every day ask a lecturer to clarify 
some point that was not clearly 
presented. 

4. Class members will practice giving 
negative feedback to one professor 
every week, first in writing, 
second by practicing with a friend, 
and third by actually saying it to 
the professor. The feedback will be 
about the lecture, lab, or teaching 
style. 



bset of Behavior Change Objectives in a 
isk Freshmen. The General Objective: 
their professors regular positive and 

Training Procedures 

1. A didactic presentation outlining the 
difference between assertive and ag- 
gressive behavior 

2. A small group exercise where class 
members practice discriminating between 
assertive and aggressive reactions to 
professors 

3. A role-playing exercise where class 
members verbally practice giving as- 
sertive feedback to mock professors 
(postive and negative) in a wide 
range of situations 

4. Diary/log of each student's progress 
kept on behavior objectives 

5. Partner chosen by each student from 
the class, who will be communicated 
with daily about the student's accom- 
plishments of behavior objectives 



ERIC 



3G 

27 



Me^od oj IntQJwzyytlon 

Program goals and the type of training developed to achieve their re- 

P^etu^/con spectlve behavioral objectives often influence how the training may be 
delivered to the Target of Intervention. Therefore, the planning team 
can enter this step in the development of programs with firm ideas about 
who win deliver the training and how the training will be offered. 

The Cube's classifications of the Method of Intervention provide ready 
definitions that describe who will offer training and how it will be 
offered. The classifications are Direct Service, Consultation and Train- 
ing, and Media. Direct Service means that the professional staff of a 
service delivers the training to consumers. It is the preferred Method 
of Intervention when training requires professional expertise or when it 
requires the credibility, assurance, or status of professionals. 

Consultation and Training means peers, volunteers, paraprofessionals, or 
allied professionals deliver the training to consumers. In this Method 
of Intervention, the deliverers are usually trained by professionals to 
deliver the training program and conduct it under the supervision of pro- 
fessionals and in consultation with them. The method of Consultation and 
Training is often the preferred Method of Intervention when resources are 
scarce and a professional's time is limited. It is also the preferred 
method when training is enhanced by the special rapport or influence that 
peers or allied professionals can establish with consumers. 

Media means training will be delivered to consumers through technical 
means such as print, computer or audiovisual aids, film, or a phone sys- 
tem tied Into tape banks. It is a preferred Method of Intervention when 
training lends itself to this type of presentation and resources are 
available to either create or DU'^chase technically packaged training. 

The team can use these classifications to define the Method of Interven- 
tion preferred for the type of training that has been developed. There 
are times, however, when factors in addition to the type of training may 
force planners to look for an alternative to the preferred Method of 
Intervention. The Cube^s Method of Intervention classifications can 
then be used as a conceptual framework for considering alternatives. 
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Obviously, just as a preferred Method of Intervention may be replaced 
with an alternative, there are situations in which a combination of 
intervention methods can be used. Again, the Cube's classification 
system serves to clarify and define these methods in a systematic way. 



To determine the program's Method(s) of Intervention, the planning team 
P^iOC2A6 should: 

1. Decide which mode of operation--Direct Service, Consultation and 
Training, or Media--would best accommodate the training that has 
been developed. In other words, does the nature of the training re- 
quire a professional staff, require the special rapport or influence 
that peers or allied professionals can establish with consumers, or 
is the training conducive to, or already available in, some media 
form? 

2. Consider whether the preferred method can meet potential demand. If 
the population to be served cannot be met adequately by the preferred 
method, the team should brainstorm ideas for the Cube^s other Methods 
of Intervention to identify and select a satisfactory alternative. 

Example: Cube Classifications Used to Select an Alternate Method of 
Intervention 



Training 



Preferred Method 



Problem 



Alternatives 



Selected Method 



Learning 
modules 
in reading 
comprehension, 
vocabulary, and 
speed building 



Direct Service 
(reading specialists) 



Funds permit 

use of one 

reading special ist; 

not adequate 

for potential 

demand 



1 . Train under- 
graduate 
ntudents to 

be paraprofes- 
sionals for the 
program 

2. Train graduate 
students in 
education to 
assist with 
program 

3. Develop more 
"self-help" 
materials 



Consultation and 
Training (use 
students trained 
and supervised 
by reading 
specialists to 
deliver the 
program) 
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If the selected Method of Intervention is Training and Consultation, the 
planning team will have two additional tasks to accomplish before planning 
the evaluation portions of the program's delivery system. It will need 
to develop training for whomever is to conduct the program in the skills 
they will need. And then based on the program's training demands, it 
will have to set criteria for choosing trainers. 

The preparation of those who will conduct the program is crucial even 
when allied professionals are the chosen trainers. Although allied pro- 
fessionals can be the most skilled pool of resource persons, it is also 
■*"rue that, without some experience, they can lack confidence and be un- 
comfortable in applying their skills to the teaching of a training pro- 
gram's specialized content. Experience in testing this program develop- 
ment model on campus has proved that, while training for allied profes- 
sionals does not have to be as extensive or intensive as for student 
volunteers or paraprofessionals, it does need to be provided. 

The design of training for trainers will be dependent upon the complexity 
of skills needed to conduct the program; the intensity of training will 
be dependent upon the skill level of those chosen to operate the program. 
To develop training for trainers, planning team members should: 

1. Follow the same process used to set program goals and behavioral 
objectives to establish behavioral objectives for the teaching ^skil Is 
needed to present the program. 

2. Select or create training tasks, exercises, or procedures that will 
achieve the behavioral objectives. 

3. Design training methodologies that will impart these skills. (For 
an example of training methodology, see Technical Appendix, pp. 
73-74.) Trainers will also need to participate in at least an ab- 
breviated form of the program or a simulation of the program as part 
of their training. 

4. Develop reading assignnents and/or instruction on the training's 
basic theory because trainers will need and want to understand more 
about the training's content than will the program's consumers. 

5. Develop an outline of the training for trainers that stateb> its 
goals. Its behavioral objectives, and its training units and con- 
comitant exercises, tasks, or procedures. 
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The planning team should give equal attention to selection criteria for 
program trainers. Selection criteria will be dependent on the depth 
and variety of skills demanded in the training balanced against the pos- 
sible skill levels of the group of people from which the planning team 
expects to choose trainers. Whenever possible it is best to select pro- 
spective trainers whose background and present skills most closely ap- 
proximate those needed to conduct the program. However, other considera- 
tions may favor training less skilled people to conduct the program. 
The planning team may prefer to have students running the program, or 
there are times--often at the beginning of a program--when those vol- 
unteering to run it possess very few of the skills needed. A good rule 
in this instance is: Take the best prospects and plan adequate time to 
train them. 

To establish selection procedures for trainers, members of the planning 
P/Loe^64/ team can: 

Sei^atlon ^' '^^^^^^P ^ selection criteria based on the skills that will be 

needed. 

2. Choose interview techniques that will provide knowledge on how many 
of these skills the candidates possess and to what degree. 

3. Select the method (s) for recruiting the candidates. 

Depending upon a planning team's given situation, the integration of 
training for trainers into the delivery system can be done in one of 
several ways. A common approach that can serve both the program's pilot 
test and the planning team's development of training for trainers is to 
have professional staff conduct the pilot test of the program as an inte- 
gral part of the effort to design the training for trainers. Beyond the 
reward of having a program in operation and under evaluation, this ap- 
proach provides setting of behavioral objectives for trainers with infor- 
mation from actual training experience. It also provides the program 
delivery system with experienced people who can become trainers and con- 
sultants for those who will be conducting the program on an ongoing basis. 

Another approach the planning team can use is to design the training for 
trainers and process the proposed trainers through the training so they 
may conduct the program's pilot test. A third approach the team may 
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choose is to design training for trainers that will prepare proposed 
trainers to conduct the program's pilot test as co-trainers with profes- 
sional staff while receiving further training in an inservice format. 

★ ★ ★ 

VKOQKam Evaiiuition 

A great deal of lip service is given to evaluation. Too often, however, 
VAJiCjjA^A^on evaluation never gets implemented, or, if implemented, its design can 

fall short of achieving maximum benefits. Therefore, an important step 

in the development of any program is planning the means and procedures 

that win be used to evaluate its results. 

A carefully constructed plan of evaluation systematically applied can 
provide the objective data necessary to demonstrate that a program has 
attained its goals. In the day of accountability when top administrators 
want to know what a program has accomplished beyond the subjective plea- 
sures of its leaders and participants, this type of data becomes invalu- 
able and is of significance in helping to substantiate budget requests 
for programming. 

The objective data obtained through systematic evaluation can also be 
useful in establishing a program's credibility with students and other 
branches of the university or college. This benefit of evaluation is 
often overlooked because many student services neglect to keep constit- 
uencies beyond their parent organizational structure informed about pro- 
grams and their results. The reporting of evaluation data to students 
and other constituencies can greatly enhance understanding and support 
for a service's undertakings. 

An equally important benefit and objective of evaluation is the informa- 
tion it can provide the planning team and the service's decision makers. 
Systematic evaluation can tell the planning team how successful the pro- 
gram is and where improvements might be made. The data also assist ser- 
vice administrators in deciding which programs should be continued or dis- 
continued. Programs that cannot demonstrate successful impact should be 
di scontinued. 
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Therefore, the time and effort it takes to design a program's evaluation 
scheme have many rewards. If there are no members of the planning team 
proficient in test and measurement skills or knowledgeable in research 
design, then it is strongly recommended that the team locate consultants 
who can assist them in planning the program's evaluation processes. 
Often such consultants can be found among colleagues in psychology, educa- 
tion, statistics, or campus research and computer centers. In practice, 
the planning team may seek assistance from one colleague to select or 
create measurement instruments and from another to develop the research 
design. A consultant can be very helpful in suggesting instruments or 
assisting with design questions. A consultant, however, should not be in 
the position of either deciding what to evaluate or making final decisions 
on evaluation methods. The team should assume the decision-making respon- 
sibility in this area, as well as in other areas of program development. 

In constructing a careful evaluation plan, the planning team will need to 
select or create instruments that measure those variables expected to 
change by virtue of the program's existence. The set of General Objec- 
tives and Behavior Change Objectives developed earlier will provide the 
basic guidelines for selecting or creating these measures. During the 
program's pilot test, these measures can be tested for reliability and 
validity, and can be subsequently refined if necessary. When data per- 
tinent to an objective or goal are collected through routine university 
statistics such as student grade-point averages, these data are a power- 
ful and useful addition and should also be used as part of the program's 
evaluation scheme. 

Thus, the measures used to evaluate a program usually fall into two cate- 
gories: first, the instruments that are administered directly to program 
participants or to significant others. These instruments might include 
participant self-reports, reports by others who are significant persons 
to participants, process evaluations, and personality or behavioral tests. 
The second category includes instruments and other data collection methods 
that are not directly administered to participants and are therefore con- 
sidered to be unobtrusive measures for program evaluation. These might 
include observer reports and information such as dropout rate, change of 
major, or other routinely collected data that are relevant to program goals 
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As important as the selection or creation of valid instruments is the 
need to have these instruments make sense to those who will be asked 
to take them. Most program participants will be willing to answer 
evaluation instruments if it is explained to them that completing the 
instruments is an integral part of their participation in the program. 
This should be reinforced by the selection or creation of instruments 
to reflect what the participants actually experience in the program. 
Explaining to participants the need for and benefits gained from eval- 
uation, as well as reporting to them the measures' results whenever pos- 
sible, also increases their willingness to take time to fill out eval- 
uation measures. 

Data from the evaluation of training programs and the training of train- 
ers when applicable can document progress, which gives both trainers and 
participants a reward for work well done and provides a continuous moni- 
toring system that reports the need for immediate adjustments, as well 
as fundamental changes, when it is time to refine and improve the pro- 
gram. Both training outcomes and process evaluation procedures should 
be systematically administered at appropriate intervals throughout the 
program. For some programs this could be at the conclusion of each train- 
ing session. For others, evaluation might be more appropriately adminis- 
tered at the conclusion of training units. 



Tn,cu,yiLng 



To develop procedures for evaluating training programs, members of the 
planning team should: 

1. Select standardized personality or behavioral instruments that 
measure one or more of the General and Behavior Change Objectives 
that were listed for training. (Suggested resources for standardized 
tests are The Seventh Mental Measurements Yearbook , edited by Oscar 
K. Buros, published by Gryphon Press, Highland Park, New Jersey, 
1972; and Experimental and Quasi-Experimental Designs for Research , 
written by Donald T. Campbell and Julian C. Stanley, published by 
Rand McNally, Chicago, 1966.) Also, a consultant with expertise in 
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the area of the training program's content could recommend instru- 
ments that would measure the desired objectives* 

2. Devise additional outcome evaluation procedures or measures for the 
objectives for which standardized tests could be selected. If the 
objectives are observable, then a reporting system from independent 
observers may be an ideal evaluation procedure. A self-report rating 
scale that participants can use to report their own judged progress 
is a simple evaluation method for other objectives on the list. 
Similar forms and questionnaires can be developed for pre- and post- 
training administration that will yield useful information. 

3. Design a simple questionnaire on training process. A very short form 
that can be used at many junctures throughout training includes the 
fol lowing: 

a. List several adjectives that describe how you feel or think about 
training. 

b. List two or more strengths of training as you experienced it. 

c. List two or more weaknesses of training as you experienced it. 

d. List two ways training might have been more understandable or 
improved. 

e. Give any additional comments you wish. 

4. Prepare or procure the evaluation materials to be used. 



IkoJjiLyiq 



To develop procedures for evaluating the training of trainers, members 
of the planning team follow the same process used above but substitute 
the planning team's list of General and Behavior Change Objectives for 
the skills needed to teach training content. 



★ ★ ★ 



After the planning team has selected or created instruments to measure 
V^(iu66lon variables expected to change as a result of the program, it will need 
to plan a research design that places the data results into a context 
that yields information concerning the program's effectiveness. A pro- 
gram's pilot offering provides the best vehicle for employing a research 
design. While ideal situations provide a true control over the variables 
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to be evaluated, in the practice of programming this is seldom possible. 
This should not negate the use of a research design in evaluating the 
program, however, because there will always be some form of control over 
variables conducive to the program's format that planners can use. 

As a general rule, the planning team should use the most powerful design 
that circumstances afford to evaluate the program's pilot offering be- 
cause the resultant data are most valuable in deciding whether to offer 
the program again in its original form or to modify it. Obviously, de- 
signs employing more than one control group provide information about the 
interaction between important variables, which is highly desirable when 
practical. However, designs employing one control group will still as- 
sess the effectiveness of a program better than evaluation designs with 
no provision for a control group. 



To develop a research design for the use of standardized tests and other 
?/ioau^ procedures that measure changes brought about by the program, members of 

the planning team should: 

1. Attempt to utilize a design that will incorporate the use of pre- 
and postmeasurement with at least one instrument or procedure. 

2. Measure program effectiveness in as many ways as is feasible. 

3. Consider the ways a control group could be set up for the program's 
pilot offering and select the one most easily accommodated by the 
program's format. In some cases it may be possible to offer the pro- 
gram to two groups simultaneously and vary the introduction of the 
variable to be tested. In other cases, when the pilot program can 

be offered to only one group, the participants will have to act as 
their own control group. Or, two offerings of the pilot program can 
be given consecutively so that one group (control) can be tested on 
the variables while the other group (experimental) participates in 
the program. The way in which the control group has to be set up 
will in large measure determine the type of research design that can 
be used. 
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4. Use as many participants as feasible and use appropriate statistics. 
Remember the general rule: the larger the N (number of participants), 
the easier it is to detect real differences between groups. 

5. Begin selection of an appropriate research design, using the input 
acquired from the above three steps. Three commonly used designs 
are explained in the Technical Appendix, pp. 75-77. A more thorough 
understanding of research methodologies applicable to evaluating pro- 
gram-effectiveness can be obtained by reading Research Methods in 
Social Relations (edited by Claire Selltiz et al . , published by Holt, 
Rinehart & Winston, Inc., New York, 1959) and Experimental and Quasi- 
Experimental Designs for Research (written by Donald T. Campbell and 
Julian C. Stanley, published by Rand McNally, Chicago, 1966). 

★ ★ ★ 



Pn.2.paAatLoyib jon. Vitot Tut 

The last tasks in Stage II entail the final preparations needed to conduct 

V^cu^^Zon the program's pilot test. At this point the team has completed the major 
planning phases of program development. The extensive planning of the 
team has determined a demonstrated need for the program: esUblished the 
program's Purpose, Target, and Method of Intervention; secureo service 
support for the program; specified the program's goals in terms of behav- 
ioral objectives; formulated all training procedures needed to achieve 
its goals and objectives; and constructed an evaluation design for as- 
sessing the program's effectiveness. Thus, a solid foundation has been 
planned from which to launch the action phases of program development. 




To prepare for the implementation of training, the planning team should: 
P/ioaeA6 1. Develop an outline of the training program that states its goals, 

its training format and concomitant exercises, tasks, or procedures, 

and its evaluation methods and design. 

Make out a program schedule of meeting times and place. 

3. Assign program administrative detail. 

4. Have program materials printed and/or procured. 
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As the team prepares for action, it will also need to consider criteria 
for selection of program participants. Criteria vary depending on the 
nature of the program's training. A program targeted on an institutional 
intervention may need criteria regarding the level of administration or 
type of personnel that the program's training should involve. Other 
training programs might set such criteria as participants' living loca- 
tion, class designation, special interests, enrollment status, or type 
of affi 1 iation . 

Skill-oriented training programs require a careful set of criteria to 
ensure that participants will benefit from the training. For example, 
a program that offers remedial skill training will probably need criteria 
to screen out participants for whom the training would be superfluous and 
criteria to screen for special deficiencies that participants might have. 
Likewise, a developmental program that offers advanced skill training 
needs criteria that screen out participants whose skill levels are not 
sufficient or criteria that identify persons for whom the training would 
not be beneficial. In some cases, planners will have to proceed with 
tentative criteria and develop more definitive criteria based on evalua- 
tion of the pilot program. 

To conclude its preparations for the program's pilot test, members of the 
planning team should: 

1. Assign the remaining tasks to be completed in a way that best utilizes 
all personnel involved in the program. 

2. Set criteria for program participants. 

3. Determine the number of participants that the program's pilot test 
will accommodate. 

4. Review all program, training, and evaluation materials for final 
approval . 

5. Develop pilot program schedules, time-line charts, or other desired 
administrative materials. 

6. Recruit candidates to be trainers, schedule interviews, and select 
trainers if the chosen method of intervention and the system of 
delivery require this as a prerequisite for the program's pilot test. 

* ★ ★ 
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?n,0Qh.am PubticuXy Vitot P^og^m JmplmzyvtcLtLon 
P^ilot Pxogxm EvaZucutlon P^ognxm Vtutu/iz 

The planning team's tasks in Stage III involve implementing and evaluating the 
program's pilot test and making a decision on whether the program should be continued 
on a regular basis. The first task is publicizing the program in order to attract 
the sample of participants who will try out the new program. The next series of tasks 
focuses on putting Stage II plans for training and evaluation into operation. The 
concluding tasks involve studying the evaluation results and coming to a decision about 
the program's future. Putting the act together and presenting it infuses welcome ex- 
citement for the often planning-wearied team, 

Pn^ognxm PubZicUty 

The best conceived and planned program can flop if its intended consumers 
VJj^ciu^Zon are not aware that it is available to them. Advertising the program's 
name, time, and place is hardly enough to support the preparatory labor 
that has gone into planning. Publicity needs to inform intended con- 
sumers why they might be interested in the program and some of the specif- 
ic benefits that could be derived from their participation. The team's 
work in specifying the program's demonstrated need, goals, and behavioral 
objectives become important material for the development of program 
publ icity. 

If no one on the planning team is competent to work up the program's 
publicity, then extra team consul tation or assistance should be obtained. 
Good resources can be found among colleagues in the graphic arts and pub- 
lic information services available on most campuses. Nor should the tal- 
ent and skills available in schools of journalism be ignored when present 
within the college or university. 
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The offering of a program's pilot test will probably not entail exten- 
P/ioc2^6 sive publicity to attract the required number of participants because 
these participants are most often randomly selected from the Target of 
Intervention who are extended an invitation to participate. The invita- 
tion will need to include some basic publicity, however, on why the pro- 
gram is being pilot tested and what benefits the participants might ex- 
pect. In those cases when participants are not invited, the team may 
wish to use a limited form or selected parts of its publicity plan to 
attract people from the Target of Intervention. In either event, the 
pilot test will need some publicity but rarely the total publicity effort 
that becomes necessary when a program is to be established on an ongoing 
basis . 

To develop effective program publicity, members of the planning team may 
find the following guidelines helpful: 

1. Publicity should be presented well in advance of the program's begin- 
ning date. 

2. Some form of publicity--flyers, brochures, posters--should be readily 
available in campus areas most used by members of the program's Target 
of Intervention, the program's intended consumers and/or participants. 

3. Publicity should be disseminated in a form and language appropriate 
to the members of the program's Target of Intervention. 

4. Program goals and behavioral objectives should be used to write clear 
statements regarding why the training is being offered, its objectives 
and procedures, and its intended benefits. 

5. Clear instructions should be given on how interested persons may par- 
ticipate in the program. 

★ ★ ★ 

?AJiot VKoQ^jom ImptmnntcutLon 

The number of activities and details that will Involve direct participa- 

Vi6cM6lon tion of planning team members during the pilot program *s implementation 
will be dependent upon the chosen Method of Intervention. However, there 
are three tasks basic to all training programs that will involve partici- 
pation of team members: (1) recruitment and selejtion of a participant 
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sample for the program's pilot test, (2) establishment of a control 
group unless the research design employs a method that uses participants 
as their own control, and (3) administration of evaluation procedures. 



implement the pilot program, team members should: 
Use a plan for the publicity needed to recruit participants. 
Choose a selected sample of participants. 
Set up a control group or groups. 

Assign member(s) of the team to oversee the administration and col- 
lection of evaluation data. 

Assign member(s) of the team to conduct any training required at 
this stage by the team's chosen Method of Intervention. At the mini- 
mum, this will entail the careful preparation for, and/or rehearsing 
of, each training task to be offered by professional personnel when a 
Direct Service Method of Intervention is used. When a Consultation 
and Training Method of Intervention is used for the pilot test of the 
program, then planning team members will have to undertake the train- 
ing procedures dictated in their design of the delivery system. 

★ ★ ★ 

Pilot VhjQQnxm EvaZucvtion 

It is very important that the planning team's evaluation design is fol- 

VAJ>aa66^on lowed. A planning team member(s) should take charge of administering the 
procedures that will collect both subjective data from the program's 
leaders and participants, as well as objective data from the instruments 
used to measure the changes expected to occur as a result of the program. 



To properly apply the planning team's evaluation design, those in charge 
P/ioc.Qj>6 of adminstering the procedures may find the following guidelines useful: 
1. There should be regularly scheduled meetings with the pilot program's 
trainers or implementors to get a report on participants' positive 



To 

2. 
3. 
4. 
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and negative feedback on content and process as well as positive 
and negative feedback from the perspectiye of those conducting the 
program. 

2. A meeting with participants should be scheduled to explain evaluation. 

3. All pre- and post-test instruments should be administered. 

4. Subjective data in a convenient form should be compiled for the plan- 
ning team's inspection. 

5. Arrangements should be made for the statistical analyses of all ob- 
jective measures to be computed and presented in summary form for 
interpretation. 

★ ★ ★ 

?/iog/im VutiUid 

After the program's pilot test, the planning team will need to consider 
VJj^cuA^lon its evaluation data and decide whether the program should be continued, 
and, if so, what changes or modifications should be made. A studied de- 
cision concerning the program's future will take more time than the in- 
tuitive decision process typically applied in developing programs. At 
least several hours will be needed for the team to study the subjective 
and objective data in terms of all the appropriate specific program goals 
and/or behavioral objectives. 

In studying the data, the planning team needs to be cautioned that, al- 
though the choice or creation of evaluation instruments in accordance 
with behavioral objectives greatly enhances the potential that these 
instruments will actually measure desired program effects, it does not 
guarantee it. The instrument chosen or created may not be valid. There- 
fore, if the planning team has strong evidence or reason to believe that 
changes occurred in participants but that these changes are not reflected 
in data from the objective measure used, then the team should take a 
closer look at the instrument in an attempt to determine what happened. 
Validation studies may be necessary before using an instrument again. 

It is recommended that the planning team reach its own decision about the 
program*s future before presenting its evaluation findings to service 
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staff at large or to the servicers decision makers. This allows the 
planning team both the time and the opportunity to complete its study 
of the data and to organize evaluation results in a comprehensive man- 
ner around the points to be made in its reconmendations. 

There are essentially three types of recommendations the planning team 
could make regarding the program*s future: (1) continue the program in 
its present form as both subjective and objective data are positive in 
support of such action; (2) continue the program with modification of: 
the specific parts of the delivery system that data have proved ineffec- 
tive, the behavioral objectives that now seem less meaningful, or the 
evaluation instruments that appear to be invalidly measuring the program's 
desired effects; or (3) discontinuation of the program because both sub- 
jective and objective data are negative. 



To facilitate their study of evaluation results and decision making on 
P/iocLQ^6 the program's future operation, members of the planning team should: 

1. Review both subjective and objective data in relation to each of the 
program*s specific goals and/or behavioral objectives. 

2. Seek consultation on instruments that appear to have invalidly mea- 
sured program variables. 

3. Decide whether the program should be continued or discontinued and 
why, supported by evaluation data. 

4. Decide what modifications will need to be made and why, supported by 
evaluation data. 

5. Write a report on the program's pilot test that states the planning 
team's recommendations illustrated by the evaluation data. 

6. Forward the report to the person or persons in the service responsible 
for prograrming and able to authorize the planning team's recommenda- 
tions if accepted. 
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stage IV 



T/uLinlyig P/ioaoxiuAQ^ and Ucuto/UjaJis P/iog/um Evaluation 
T/uxAnlng OjJ T^aimu P/iog/Lom OiioAying 



If the planning team and responsible service or agency concur in a decision to 
continue the new program, the next tasks in the program development process focus on 
refining the team's planning done in Stage II and implementing any modification the 
team has suggested as a result of the program's pilot test and evaluation. Based on 
what has been learned as a result of the progrcim*s pilot test and evaluation data, 
each major component of the program is reviewed in order to refine its delivery system. 
If a Consultation and Training Method of Intervention is used, the planning team may 
also want to begin long-range plans for the training of trainers. 

Whatever needs to be done, attention will concentrate mainly on needed adjust- 
ments in training procedures, materials, and evaluation measures. It is recommended 
that the planning team give itself adequate time to complete Stage IV tasks before re- 
offering the program. This is particularly important if the team's chosen system of 
delivery calls for the phasing in of allied professionals or paraprofessionals to 
operate the program after its pilot test. 

THXhin^ng P/ioaoxluAPJi and Mat2AAXiZ6 

The training procedures and materials developed for the pilot test of a 

Vl^aiu^lon program need to be reviewed and refined. The planning team now has the 
evaluation data and perspective necessary to decide what training pro- 
cedures need modification and where written, audio, and visual material 
could be used in training. It may want to add training procedures or 
materials, it may need to replace ineffective procedures or materials, or 
it may want to eliminate some procedures or materials. 
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In its review and refinement of training procedures and materials, the 
Pn,ocu^ planning team may find the following set of questions useful. 

1. Are there concepts or expected behaviors that are difficult for 
trainers and/or participants to understand that might be more 
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effectively presented by another type of training task or procedure 
or through some type of audio or visual model? 

2. Is time being taken to say things that could just as easily be read 
and understood by trainers and/or participants? 

3. Are there informational materials that trainers and/or participants 
should have available for reference throughout their training or 
program experience? 

4. Are all materials for trainers and participants written in a clear, 
concise style so that content and instructions are easily understood 
and able to be implemented? 

* * ★ 

?KOQKm EvaZucution 

There are a number of reasons why the team should reassess program ef- 

V^^cjLU>6^on fectiveness. Certainly any redevelopment or modification of training 
necessitates reevaluation. Although no changes are made, it still is 
desirable to reassess the program using a more powerful research design. 
Even if a new design is not employed, it is necessary to repeat an eval- 
uation because when a new program is given a pilot test its trainers and 
participants may be so involved and excited with its "newness," that 
measures of effectiveness can be spuriously evaluated by this "primary" 
' effect. Nor should the planning team overlook the many benefits that a 
program's continued evaluation can bring in terms of support for the pro- 
gram and its parent service or agency. 

As was the case in the program's initial evaluation, research is conducted 
in order to demonstrate the overall effectiveness of training, and to iso- 
late the effectiveness of the individual training units. The resulting 
evaluation data will again provide feedback regarding the most effective 
and least effective units. This information is essential to further 
program planning and refinement. 
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In making plans for the program's continued evaluation, the planning 
P/L0ce6^ team needs to; 

1. Employ as powerful a design as is feasible. 

2. Consider the use of more than one control group to provide informa- 
tion about the interaction between important program variables. 

3. Consider an experimental research study on the interaction between 
Various participant characteristics, trainer characteristics » and 
criteria used to measure program effectiveness. 

★ ★ ★ 

Whereas in Stage III the training of trainers might have received less 
VAJ>au6^lon attention because professional staff conducted the program's pilot test, 
careful attention is needed in Stage IV if the program's continuing 
Method of Intervention is to be Consultation and Training. In light of 
the experience gained from the program's pilot test, the team should re- 
view its plans for the training of trainers and make whatever modifica- 
tions are needed. At this juncture, the team may wish to make some long- 
range plans for training procedures as well. 

An issue that often comes up after a new program has become established 
and is offered regularly is who should continue to train the trainers. 
While it is usually essential that a member or members of the planning 
team train trainers during initial offerings of the program, this could 
become too demanding on the professionals* time as the program expands. 
However, a reservoir of trained and experienced trainers is building as 
the program expands* So the planning team may wish to begin thinking 
about the tasks that experienced trainers could assume in the training 
of new trainers. This saves professionals' time, and perhaps more im- 
portant, gives training a realistic approach that the theorizer may lose 
over time. 

Eventually, a mature program that uses peers, volunteers, paraprofes- 
sionals, or allied professionals should have a systematic selection pro- 
cess, a wel 1-sequenced preprogram training experience, ongoing in-service 
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training, professional back-up system, and the specification of training 
tasks to be mastered by each level of personnel involved in the program. 
Each of these elements will deserve individual attention by the planning 
team as it reviews and refines the program's training design and makes 
long-range plans. 



In its review and refinement of the training designed in Stage II, the 
PAoce64 planning team may wish to consider one or more of the following sugges- 
tions : 

1. If trainers need a number of skills (such as facilitating, organizing, 
and consulting), the team may find it helpful to train different 
people for different roles rather than train everyone for each role. 

2. An internship approach is useful in training trainers to lead less 
structured programs, for it can provide the leader trainee with in- 
tensive supervision and feedback as he/she works in the program. 

3. If students are being trained to lead the program, often it is pos- 
sible to set up training that extends over a quarter or semester and 
offers academic credit. Many departments have special studies courses 
that can be utilized for this purpose. 

4. When all training does not need to occur before the trainee is able 
to offer some service in the program, good use can be made of in- 
service training. In fact, the trainee*s confidence and motivation 
for further training may be enhanced by the opportunity to participate 
in some leadership functions. Yet because program consumers have the 
right to expect competent training, the planning team must be careful 
not to value the growth of the prospective trainer over that of the 
program participant. 

5. And finally, the planning team may want to identify those tasks in 
its training of trainers that could be taught by experienced trainers 
rather than by professional personnel. 

★ ★ ★ 
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PH.ogn.m 0U^y^9 

When the above tasks have been completed, the planning team 1s ready to 
offer the program on a regular basis to larger numbers of the target 
population. Its publicity plan should be implemented in full and addi- 
tional personnel may be brought into the program to improve its day-to- 
day operations. As the program is repeated, the planning team should 
watch for ways to improve organizational procedures such as publicity, 
room scheduling, the collection of evaluation data, the distribution of 
program materials, and the dissemination of evaluation reports to in- 
terested constituencies. 

★ ★ ★ 
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stage V 



Stage V processes address two ongoing tasks associated with a program that be- 
comes offered on a regular basis. The foremost task is program maintenance. Need 
assessment and program evaluation are the processes central to program maintenance. 
The other task that often emerges as the result of a program is responding to new 
ideas spun off the original program. The process central to this task is a recycling 
of the Program Development Model. 

In addition to keeping careful watch over the data collected through 
V^au^lon continuous evaluation procedures, the planning team will need to period- 
ically readdress some of the important issues covered in the first four 
stages in order to properly maintain a successful long-running program. 
This is particularly important to student service programming- because 
changing student populations and characteristics necessitate changes in 
program priorities and methods of delivery. 



To keep its program active, the planning team should answer with suf- 
ficient supporting data the following questions: 

1. Is there still a demonstrated need for the program? 

2. Do the current delivery system procedures still accomplish the pro- 
gram's intended objectives? 

3. Has the target, program personnel, level of training, or implementa- 
tion changed enough so that an objective reevaluation of the program 
is necessary? 

4. Are staff resources and funding still adequate to maintain the pro- 
gram? 

5. Has priority for the program changed? 
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The answers to these questions will provide the planning team and 
service staff appropriate information on which to make decisions re- 
garding the program in light of the service's priorities and other pro- 
grams. 

★ ★ ★ 



P/iog/icun Sp^n-o^^ 

The original program may spin off a new, but related, program idea for 
VX^atu^lon the same Target of Intervention. Or a member or members of the planning 
team may feel the original program idea could serve a new Target or 
Purpose of Intervention. An example of a new, but related, program idea 
for the same Target of Intervention might be a workshop on constructive 
fighting or a workshop on enhancing sexuality for married couples as a 
spin-off from doing a workshop on general communications for married 
couples. An example of changing the original idea's Target of Interven- 
tion might be the redesign of a communications workshop for individual 
students to be a workshop for an associational group (fraternity, class, 
club) to help improve its communication process. And an example of 
changing the original idea's Purpose of Intervention might be redesigning 
a remedial interpersonal skills program to be a developmental interperson- 
al skills program. 

Although spin-off ideas for new programs are related to the original pro- 
gram and often can use the same skills, personnel, and much of the orig- 
inal program's materials, the planning team cannot assume there is a dem- 
onstrated need for the new idea or that the responsible service or agency 
will be committed to the new idea just because it supported the original 
program.- Thus, the spin-off idea becomes a germinal idea for the program 
development process. 



Team members interested in developing the spin-off program should return 
P/iocQ^^ to Stage I and begin the process over by recruiting additional planning 

team members in accordance with their germinal idea's content area and 
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the intended consumers. In this manner, program development can become 
a continuous process. Teams will gain more confidence and expertise each 
time they cycle a new venture through the Program Development Model's 
five stages. 

★ ★ ★ 
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TECHNICAL APPENDIXES 




TECHNICAL APPENDIX A 
AN EXAMPLE MAPPING OF COUNSELING CENTER PROGRAMS ON THE CUBE* 





PURPOSE 




Remediation 


Prevention 


Development 




METHOD 


METHOD 


METHOD 


TARGET 


Direct 

OCI V ll^C 


Consultation 
& Trainina 


Media 


Direct 
Service 


Consultation 
& Training 


Media 


Direct 
Service 


Consultation 
& Training 
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Individual 


Individual 
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Peer 

counseiing 


Film: 
How to 
deal with 
depression 


Communica- 
tion skills 
workshop 










Computerized 
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modual 


Primary 
Group 


Marital 
counseiing 


Clergy 
workshop 
in marital 
counseling 




Premarital 
workshop 






Child-rearing 
classes for 
parents 


Marital 

enrichment 

workshop 


Films on 

constructive 

parenting 
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. Group 


Conflict 
resolution In 
Psych. Dept. 






Workshop for 
professors: 
making 
referrals 






Video-recall 
groups for 
assistants 




Film: 
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or 

Community 


Consultation 
with dean 
about dept. 
heads 






Workshop for 
dept. heads 
on student 
decisions 













• From Morrill, Oettmg, and Hurst. 
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TECHNICAL APPENDIX B 



WHAT TO LOOK FOR IN GROUPS* 

In all human interactions there are two major ingredients^-content and process. 
The first deals with the subject matter or the task upon which the group is working. 
In most interactions, the focus of attention of all persons is on the content. The 
second ingredient, process, is concerned with what is happening between and to group 
members while the group is working. Group process, or dynamics, deals with such items 
as morale, feeling, tone, atmosphere, influence, participation, styles of influence, 
leadership struggles, conflict, competition, cooperation, etc. In most interactions, 
very little attention is paid to process, even when it is the major cause of ineffec- 
tive group action. Sensitivity to group process will better enable one to diagnose 
group problems early and deal with them more effectively. Since these processes are 
present in all groups, awareness of them will enhance a person ^s worth to a group and 
enable him to be a more effective group participant. 

Below are some observation guidelines to help one process analyze group behavior. 

PajuticiLpcutcon 

One indication of involvement is verbal participation. Look for differences in 
the amount of participation among members. 

1. Who are the high participators? 

2. Who are the low participators? 

3. Do you see any shift in participation, e.g., highs become quiet, lows sudden- 
ly become talkative. Do you see any possible reason for this in the group's 
interaction? 

4. How are the silent people treated? How is their silence interpreted? Consent 
Disagreement? Disinterest? Fear? etc. 

5. Who talks to whom? Do you see any reason for this in the group*s interactions 

6. Who keeps the ball rolling? Why? Do you see any reason for this in the 
group's interactions? 



*This exercise is taken from J. William Pfeiffer and John E. Jones (eds.). The 1972 
Annual Handbook For Group Facilitators , pp. 21-24. La Jolla, OA: University Asso- 
ciates, Inc., 1972, and is reprinted with their permission. 
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Influence and participation are not the same. Some people may speak very little, 
yet they capture the attention of the whole group. Others may talk a lot but are gen- 
erally not listened to by other members. 

7. Which members are high in influence? That is, when they talk others seem to 
1 isten. 

8. Which members are low in influence? Others do not listen to or follow them. 
Is there any shifting in influence? Who shifts? 

9. Do you see any rivalry in the group? Is there a struggle for leadership? 
What effect does it have on other group members? 

Influence can take many forms. It can be positive or negative; it can enlist 
the support or cooperation of others or alienate them. How a person attempts to in- 
fluence another may be the crucial factor in determining how open or closed the other 
will be toward being influenced. Items 10 through 13 are suggestive of four styles 
that frequently emerge in groups. 

10. Autocratic: Does anyone attempt to impose his will or values on other group 
members or try to push them to support his decisions? Who evaluates or 
passes judgment on other group members? Do any members block action when it 
is not moving in the direction they desire? Who pushes to "get the group 
organized?" 

11. Peacemaker: Who eagerly supports other group members' decisions? Does any- 
one consistently try to avoid conflict or unpleasant feelings from being ex- 
pressed by pouring oil on the troubled waters? Is any member typically de- 
ferential toward other group members--give them power? Do any members appear 
to avoid giving negative feedback, i.e., who will level only when they have 
positive feedback to give? 

12. Laissez faire: Are any group members getting attention by their apparent 
lack of involvement in the group? Does any group member go along with group 
decisions without seeming to commit himself one way or the other? Who seems 
to be withdrawn and uninvolved; who does not initiate activity, participates 
mechanically and only in response to another member's question? 

13. Democratic; Does anyone try to include everyone in a group decision or dis- 
cussion? Who expresses his feelings and opinions openly and directly with- 
out evaluating or judging others? Who appears to be open to feedback and 
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criticisms from others? When feelings run high and tension mounts, which 
members attempt to deal with the conflict in a problem-solving way? 

Many kinds of decisions are made in groups without considering the effects of 
these decisions on other members. Some people try to impose their own decisions on 
the group, while others want all members to participate and share in the decisions 
that are made. 

U. Does anyone make a decision and carry it out without checking with other 
group members? (Self-authorized,) For example, he decides on the topic to 
be discussed and immediately begins to talk about it. What effect does this 
have on other group members? 

15. Does the group drift from topic to topic? Who topic-jumps? Do you see any 
reason for this in the group's interactions? 

16. Who supports other members' suggestions or decisions? Does this support re- 
sult in the two members deciding the topic or activity for the group (hand- 
clasp)? How does this affect other group members? 

17* Is there any evidence of a majority pushing a decision through over other 
members' objections? Do they call for a vote (majority support)? 

18. Is there any attempt to get all members participating in a decision (consen- 
sus)? What effect does this seem to have on the group? 

10. Does anyone make any contributions which do not receive any kind of response 
or recognition (plop)? What effect does this have on the member? 

Ta6fe FunctA^oiU 

These functions illustrate behaviors that are concerned with getting the job done, 
or accomplishing the task that the group has before it. 

20. Does anyone ask for or make suggestions as to the best way to proceed or to 
tackle a problem? 

21. Does anyone attempt to summarize what has been covered or what has been going 
on in the group? 

22. Is there any giving or asking for facts, ideas, opinions, feelings, feedback, 
or searching for alternatives? 

23. Who keeps the group on target? Who prevents topic-jumping or going off on 
tangents? 
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These functions are important to the morale of the group. They maintain good and 
harmonious working relationships among the members and create a group atmosphere which 
enables each member to contribute maximally. They insure smooth and effective team- 
work within the group. 

24. Who helps others get into the discussion (gate openers)? 

25. Who cuts off others or interrupts them (gate closers)? 

26. How well are members getting their ideas across? Are some members preoccu- 
pied and not listening? Are there any attempts by group members to help 
others clarify their ideas? 

27. How are ideas rejected? How do members react when their ideas are not ac- 
cepted? Do members attempt to support others when they reject their ideas? 

Gn^owp ktmo^pkoAt 

Something about the way a group works creates an atmosphere which in turn is re- 
vealed in a general impression. In addition, people may differ in the kind of atmo- 
sphere they like in a group. Insight can be gained into the atmosphere characteristic 
of a group by finding words which describe the general impressions held by group mem- 
bers. 

28. Who seems to prefer a friendly congenial atmosphere? Is there any attempt 
to suppress conflict or unpleasant feelings? 

29. Who seems to prefer an atmosphere of conflict and disagreement? Do any mem- 
bers provoke or annoy others? 

30. Do people seem involved and interested? Is the atmosphere one of work, play, 
satisfaction, taking flight, sluggishness, etc.? 

A major concern for group members is the degree of acceptance or inclusion in the 
group. Different patterns of interaction may develop in the group which give clues to 
the degree and kind of membership. 

31. Is there any sub-grouping? Some times two or three members may consistently 
agree and support each other or consistently disagree and oppose one another. 

32. Do some people seem to be "outside" the group? Do some members seem to be 
"in"? How are those "outside" treated? 

33. Do some members move in and out of the group, e.g., lean forward or backward 
in their chairs or move their chairs in and out? Under what conditions do 
they come in or move out? 
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ftoJUng^ 

During any group discussion, feelings are frequently generated by the inter- 
actions between members- These feelings, however, are seldom talked about. Observers 
may have to make guesses based on tone of voice, facial expressions, gestures, and 
many other forms of nonverbal cues. 

34. What signs of feelings do you observe in group members: anger, irritation, 
frustration, warmth, affection, excitement, boredom, defensi veness , competi- 
tiveness, etc.? 

35. Do you see any attempts by group members to block the expression of feelings, 
particularly negative feelings? How is this done? Does anyone do this con- 
sistently? 

Honm 

Standards or ground rules may develop in a group that control the behavior of its 
members. Norms usually express the beliefs or desires of the majority of the group 
members as to what behaviors should or should not take place in the group. These norms 
may be clear to all members (explicit), known or sensed by only a few (implicit), or 
operating completely below the level of awareness of any group members. Some norms 
facilitate group progress and some hinder it. 

36. Are certain areas avoided in the group (e.g., sex, religion, talk about 
present feelings in group, discussing the leader's behavior, etc.)? Who 
seems to reinforce this avoidance? How do they do it? 

37. Are group members overly nice or polite to each other? Are only positive 
feelings expressed? Do members agree with each other too readily? What 
happens when members disagree? 

38. Do you see norms operating about participation or the kinds of questions that 
are allowed (e.g., "If I talk, you must talk"; "If I tell my problems you have 
to tell your problems")? Do members feel free to probe each other about their 
feelings? Do questions tend to be restricted to intellectual topics or events 
outside of the group? 

★ ★ ★ 
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TECHNICAL APPENDIX C 



TEAM-BUILDING TECHNIQUES 

Introductory Exercise for Team Members 

Often, membership on a program development planning team is the first time that 
people with diverse responsibilities and positions on campus have met or talked with 
each other. The following process offers a simple yet informative and interesting 
way for the planning team members to become acquainted. The planning team leader 
should: 

1. Prepare to pair each team member with another he/she does not know. 

2. Explain to team members that they will be paired off with another member and 
be given ten minutes to learn as much as possible about each other's back- 
ground, interests, and job in order to introduce the colleague to the team. 

3. Have team members join in assigned pairs and interview each other. 

4. Reassemble the team after ten minutes and allow a few minutes for team mem- 
bers to prepare their colleague's introduction. 

5. When everyone is ready, ask each team member in turn to introduce the col- 
league he/she interviewed. 



Residence Halls: A Consensus-seeking Task* 

GoaZ^ 

L To study the degree to which members of a group agree on certain values. 
II. To assess the decision-making norms of the group. 
III. To identify the "natural leadership" functioning in the group. 



*This exercise is taken from J. William Pfeiffer and John E. Jones (eds.), A Hand- 
book of Structured Experiences for Human Relations Training , pp. 72-74, Vol. 1 
(Rev. ). La Oolla, CA: University Associates, Inc., 1974, and is reprinted with 
their permission. 
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G/ioap S^ze 

Between five and twelve participants. Several groups may be directed simulta- 
neously in the same room. (Synergistic outcomes are more likely to be achieved by 
smaller groups, i.e., five to seven participants.) 

Approximately one hour. 

I. Copies of the Residence Halls Ranking Sheet for all participants. 
II. Pencils for all participants. 

?hij6l(iaJi Se;ttcng 

It is desirable to have small groups seated around tables and to have the groups 
far enough apart so as not to disturb each other. Lapboards or desk chairs may be 
utilized instead of tables. 

I. The facilitator forms groups and announces that they will engage in an 
activity to accomplish the goals spelled out above. 
II. He distributes copies of the Residence Halls Ranking Sheet. The facilitator 
functions as a timekeeper according to the schedule on the sheet. One or more 
members may function as process observers. (See "Process Observation,'^ Vol. 1: 
Structured Experience 10.) 
III. After the allotted time, the group discusses the process in terms of stated 
goals. 

\lojujoutioM 

I. The ranking sheet can be easily revised to fit situations other than residence 
halls. The content may be the goals of the organization or group, characteris- 
tics of an ideal leader, desirable characteristics of teachers (principals, 
ministers, counselors, supervisors, employers, etc.), or any other relevant 
list. One suggestion might be to conduct a problem census of the organization 
or group and to use that list as the items to be rank-ordered. 
II. When several groups in the same organization (class, institution, etc.) engage 
in this experience simultaneously, it is sometimes helpful to summarize the 
rank orders for the several groups and to have a discussion of the agreements 
and disagreements among the groups. 
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Similar Structured Experiences ; Vol. I: Structured Experience 11; Vol. II: 30; Vol. 
Ill: 64, 69; '11 Annual: 77; Vol. IV: 115. 

Lecturette Sources : '73 Annual: "Synergy and Consensus-Seeking," "Value Clarification." 
Notes on the use of "Residence Halls": 



RESIDENCE HALLS RANKING SHEETS 

Rank the following functions of the residence hall system according to the impor- 
tance [/oa attach to them. Write the number 1 in front of the most important, the num- 
ber 2 before the second most important, etc. You have ten minutes for this task. 

After members of your group have finished working individually, arrive at a rank 
ordering a g/ioup. The group has thirty minutes for the task. Do not choose a 
formal leader. 

Individual Group 
Rank Rank 

Residence halls exist to help college students develop social 

maturity. 

Residence-hall organizations should militate for improving the 

quality of student life. 

The residence hall is where students develop business and social 

contacts that will be helpful after graduation* 

Residence halls provide a "home away from home" where the resi- 
dent is accepted and wanted, 

The residence-hall system encourages worthwhile fellowship. 

The residence hall is an experiment in living, through which 

the student comes to know his prejudices and tried to overcome 
them. 

Participation in residence-hall activities is training for lead- 
ership in adult life. 

Residence halls support and enhance the classroom learning ex- 
perience of students. 
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In the residence-hall system, students are treated as adults, 

not as adolescents who need to be controlled. 

Residence halls function as laboratories for democratic action. 



Process Observation: A Guide* 

GoaJU 

I. To provide feedback to a group concerning its process. 
II. To provide experience for group members in observing process variables in 
group meetings. 

Copies of the Process Observation Report Form. 

Participants take turns as process observers, a different observer for each meet- 
ing. The observer does not participate in the meeting but records his impressions on 
the Process Observation Report Form. At the end of the meeting, the observer makes an 
oral report of his observations, and his report is discussed. It is helpful for the 
first observer to have had some experience at such observation and for participants to 
have copies of the form while he is reporting. 

Voi/ujOition^ 

I. Sections of the observation form can be assigned to different participants in 
advance of the meeting. 
II. Two observers can be used instead of one, to check accuracy of observations. 
III. The meeting can be videotaped, and the entire group can use the form to ana- 
lyze the process. 

IV. The observer can participate in the meeting while he is observing. 



*This exercise is taken from J. William Pfeiffer and John E. Jones (eds.), A Hand - 
book of Structural Experiences for Human Relations Training , pp. 45-48, Vol. 1 
(Rev. ). La Jolla, CA: University Associates, Inc., 1974, and is reprinted with 
their permission. 
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Similar Structured Experiences : Vol. I: Structured Experience 6; Vol. II: 37, 38, 39; 

Vol. Ill: 55; '11 Annual: 79; '73 Annual: 92. 

Lecturette Source : '73 Annual: "A Model of Group Development." 

Notes on the use of "Process Observation": 



PROCESS OBSERVATION REPORT FORM 



Group_ 



ly\tQJipVi^Q)xcxt CommuniccUlon Skltti> 

1. Expressing (verbal and nonverbal) 

2. Listening 

3. Responding 



Date 



CommuyilccLtton PcutteAn 

4. Directionality (one-to-one, one-to-group, all through a leader) 

5. Content (cognitive, affective) 



Major roles (record names of participants) 

Information- processor _ 

Coordinator _ 

Eval uator _ 

Harmonizer _ 
Gatekeeper 



7. Leadership style 

Democratic 



Autocratic 



8. Response to leadership style 

Eager participation 

Lack of enthusiasm 



Low commitment 
Holding back 



Fol lower 
Blocker 

Recogni tion-seeker 

Dominator 

Avoider 



Laissez-faire 



Resisting 
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Ctbnatz 

9. Feeling tone of the meeting 

10. Cohesiveness 

11. Explicitness 

12. Commitment to agreed-upon goals 

S^mtioYiat Va/UabZoA 

13. Group size 

14. Time limit 

15. Physical facilities 

G/ioup VevoZojome^yvt 

16. State of development 

17. Rate of development 

0b6 2AVQA Reaction 

18. Feelings experienced during the observation 

19. Feelings "here and now" 

20. Hunches, speculations, and ideas about the process observed 

★ ★ ★ 
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APPENDIX D 



BRAINSTORMING PROCESS 

The purpose of this brainstorming process is to stimulate as many ideas as pos- 
sible about a subject in a time-limited period and to deal with the ideas in an order- 
ly manner. The process contains three steps--idea giving, idea review j and idea se- 
lection. In step one, a free flow of creative ideas is generated. In step two, these 
ideas are evaluated and otherwise screened for their potential usefulness; to assist 
their review, the ideas should be grouped or put into categories. In step three, the 
ideas having greatest potential are selected. 



1. Designate two people to record the ideas that will be offered by members of 
the group during the first step of the brainstorming process. Two people are 
recommended because they can alternate the recording of ideas. (This main- 
tains the flow of thoughts by reducing the number of requests to repeat an 
idea that can otherwise occur if one person tried to record all the ideas.) 

2. Have a supply of paper and pencils or pens for the recorders. 

3. Have a blackboard or large newsprint sheets and chalk or markers available 
for use in steps two and three, the review and selection of ideas. 

4. Have a watch or clock with which to time the idea-producing session in the 
brainstorming process. 

1. Formulate the subject tu be brainstormed about into a question specific 
enough on which to focus everyone's thinking. When ideas for a broad topic 
are needed, use several idea-producing sessions and focus each to generate 
ideas about one aspect of the topic. For example, if the subject to be 
brainstormed about is learning skills that will be to be incorporated into a 
program, the topic could be considered in a series of sessions according to 
each category of students intended to participate or according to each type 
of ability the participants are expected to acquire. 

2. Explain the purpose and procedures of brainstorming to the members of the 
group. 75 
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3. Practice an idea-producing session with a light or humorous topic such as. 
How could men's pants be improved? before using the technique on the actual 
subject matter. 

1. Each member of the group is to suggest as many ideas as possible in answer 
to the question. In giving ideas to the group, members should not be inhib- 
ited by issues of practicality or values. Rather, they should be free-wheel- 
ing in their suggestions because an outlandish idea can often contain the 
seeds for something that is unique and possible, or the idea can trigger 
another idea that is workable. 

2. The triggering of ideas is common to the brainstorming technique. "Hitch- 
hiking" on another member's idea with a related idea is encouraged. 

3. Because the brainstorming process relies on all types of ideas, the making of 
judgmental or critical comments about suggested ideas should be confined to 
the review of ideas in step two and is prohibited during the idea-producing 
session in step one. 

4. Each idea should be recorded but not the name of the member who suggested the 
idea. It may also be helpful for the group's leader to repeat each idea and 
indicate which recorder is to write it down. It would also be helpful if 
those recording take down only words that are key to the idea rather than 
every word. 

5. Set a ten- or fifteen-minute limit for step one. However, the group may 
prefer a variation or modification on this time limit. Group members might 
choose to set a longer time period for idea giving or they may wish to brain- 
storm ideas for ten minutes, have these read back to them, and then go on 
with an additional ten minutes of idea giving. 

6. Group the suggested ideas for review and decide which of them are most 
promising. 

7. Based on group consensus, rank-order the most promising ideas to establish 
each idea's priority. 

8. Select the ideas with greatest potential and high-ranking priority. 

•A" * 
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APPENDIX E 



BEHAVIOR CHANGE TRAINING METHODOLOGY* 

A behavior change training mode! is presented below in two parts. First, the 
five steps of the behavior change training model are explained. Then, these steps 
are illustrated through a specific training procedure from The Student Couples' 
Seminar: A Leader's Manual , 

The five steps in the behavior change training model are: 

1. EXPLAIN to those being trained the objectives of your training procedure 
and exactly what the training procedure entails. That is, tell what you 
intend to do and why. 

2. DEMONSTRATE the training procedure so that the trainees can observe the de- 
sired behavior change being reached. This may be accomplished by either of 
two means: a lecture presentation laden with clear examples or an audio- 
visual model of the behavior change objective being effectively achieved. 
Either way, the effect is to take the trainees through the training process 
via ample illustrations. 

3. PRACTICE provides the trainees with an opportunity to implement the behavior 
change objective being taught by role playing their behavior change and/or to 
practice the behavior change with actual persons or situations toward which 
the change is directed. 

4. PERFORMANCE FEEDBACK occurs in both role playing and actual practice: the 
FEEDBACK about how well a trainee has PERFORMED the desired behavior change 
is given by the trainer and/or other trainees. 

5. DISCUSSION with trainees, when they compare the training objectives with the 
practicing they have just finished, allows them an opportunity to INTEGRATE 
their understanding of the change objective with their own practice experience. 

The Good Feedback Communication Exercise used in the CSU marital enrichment work- 
shop illustrates the behavior change model in practice. The exercise consists of two 
elements: constructing feedback statements to give to one's spouse, and actually giving 
and receiving the feedback statements. 

*From M. Moore and J. Hinkle, The Student Couples' Seminar: A Leader's Manual . Fort 
Collins, CO: Colorado State University Counseling Center, 1970. 
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The workshop leader first EXPLAINS element one, the criteria for constructing 
good feedback statements. "Good feedback statements are (1) descriptive of feelings 
rather than evaluative of the other person; (2) specific rather than general; and (3) 
about behavior that can be changed, except when giving complimentary feedback." 
Actual examples of good feedback statements accompany the explanation explicitly 
DEMONSTRATING its meaning, i.e., "I feel angry toward you when you don't pick up your 
clothes in the morning." The trainees are then asked to construct from short descrip- 
tions they have previously written about their partners four feedback statements: two 
complimentary ones and two negative, angry ones. 

Element two, the three-step process by which the good feedback statements are 
given and received, is then EXPLAINED: 

Step 1: Partner 1 addresses feedback statement to Partner 2. 

Step 2: Partner 2 says, "What I hear you saying to me is . . .," and repeats 
the statement until Partner 1 indicates that it has been received 
accurately. 

Step 3: Partner 2 then responds to Partner I's feedback statement with "Inside 
I feel . . . about your statement," 

The three-step process is DEMONSTRATED by an audio-tape of a married couple 
actually giving and receiving positive and negative feedback statements. The demonstra- 
tion tape offers a model of the communication exercise being performed as explained. 

In the next step, trainees PRACTICE giving and sending their own feedback state- 
ments as demonstrated, but with partners other than their spouses. In this case, 
trainees follow the model with less anxiety and better performance by ROLE PLAYING 
with a practice partner. PERFORMANCE FEEDBACK is given by other couples and the work- 
shop leader. Subsequently, trainees ACTUALLY PRACTICE the good feedback exercise with 
their own spouses. As in the role-playing situation, PERFORMANCE FEEDBACK is given by 
the observing couple and the trainer. Finally, all trainees share with each other 
their affective and cognitive reactions to all the previous steps in the training pro- 
cess. This DISCUSSION facilitates the trainees' INTEGRATION of the training objectives 
with their own learning experience, 

★ ★ ★ 
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APPENDIX F 



THREE COMMON RESEARCH DESIGNS 

?n,t-?06tdQ^lQYi voWi One CorvOiol G/ioup 

The design most often used in assessing effectiveness of pilot programs consists 
of pre- and postprogram measurements on the dependent variables with one control group 
(Figure 1 lists the conditions for this simple design). Note that, for this design, 
as in all experimental designs involving control groups, the experimental and control 
groups are randomly selected before introducing the treatment (program). 

Figure 1: Conditions comprising the pre- and postdesign 
with only one control group 





Conditions 


Experimental 
Groups 


Control 
Groups 


1. 


Prior selection of groups 


Yes 


Yes 


2. 


Pretreatment measure 


Yes 


Yes 


3. 


Random assignment of subjects 


Yes 


Yes 


4. 


Exposure of S.s to treatment (program) 


Yes 


No 


5. 


Exposure of S.s to uncontrolled events 


Yes 


Yes 


6. 


Post-treatment measure 


Yes 


Yes 



Two problems occur when this design is used to evaluate pilot programs, (1) 
It is difficult to make subject composition in the experimental and control groups 
equivalent. (2) It is difficult to assign subjects randomly because of such complex 
situations as having to schedule experimental group participants when volunteer leaders 
are free. These difficulties can be remedied by offering a program during two consec- 
utive time periods. Using this design, the program is provided for every experimental 
group. 

P/in-P/in/Po^tdulgn iA)AXh Subjtct^ VKovldinQ Om CorvOiol G/ioup 

The second design employs program participants as their own control group* Two 
preprogram measures and one postprogram measure are obtained on the dependent variable 
(Figure 2 lists the conditions for this design). In this design program, effectiveness 
is assessed by comparing the difference between pretest 1 and pretest 2 and the dif- 
ference between pretest 2 and the post-test. Two situations justify the use of this 
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design: (1) when investigators have good reason to believe that the preprogram measures 
will not affect either response to the treatment (program) or the postprogram measure, 
and (2) when it is not likely that there are other influences during exposure to un- 
controlled events and during the program that might bias the subjects' responses to 
the post-test. When program planners can prepare the evaluation instrument far enough 
in advance, this design is a potential alternative. 

Figure 2: Conditions comprising pre-pre/postdesign 
with Ss as their own control 





Conditions 


Subject Group 


1. 


First pretreatment measure 


Yes 


2. 


Period when S^s are exposed to uncontrolled events 






but not treatment (program) 


Yes 


3. 


Second pretreatment measure at the beginning of program 


Yes 


4. 


Exposure of S_s to treatment (program intervention) 


Yes 


5. 


Post-treatment measure 


Yes 


?06tdu^gn [^Ajth One Coyvt/iol G/ioup 






The third design consists of one postprogram measure only on 


the dependent 


ables with one control group (Figure 3 lists the conditions for this design). 




Figure 3: Conditions comprising post-test only 






design with one control group 






Experimental Control 




Groups 


Groups 


1. 


Prior selection of groups Yes 


Yes 


2. 


Pretreatment measure No 


No 


3. 


Exposure of S_s to treatment (program) Yes 


No 


4. 


Exposure of S_s to noncontrol led events Yes 


Yes 


5. 


Post-treatment measure Yes 


Yes 



To maximize this design, subjects should be randomly assigned to the control group 
from a common population prior to introducing the program intervention. This is often 
difficult to do in reality when evaluating an outreach program in an applied setting. 
It is sometimes necessary, although not as highly recommended, to assign subjects on 
some practical basis or to derive a control group sample after or during the program 
intervention. For example, it may be necessary to treat one class and use another as 
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control. If two groups (experimental and control) are similar on general characteris- 
tics, including initial position on the dependent variable, programmers still will be 
able to assess the effectiveness of the pilot program better than if they had no 
control group at all . 
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